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Background: Adherence with therapy could influence the progression of glaucoma and 
ultimately affect the onset of visual impairment in some individuals. This feasibility study 
evaluated the measures to be used for a future randomized controlled trial assessing the effects 
of group-based education on adherence with eye drops. 

Methods: People diagnosed with glaucoma within the previous 12 months attending a regional 
ophthalmology clinic in the North West of England were recruited. A two-session education 
program delivered one week apart had been devised as part of a previous project. A combined 
adult learning and health needs approach to education was taken. Outcomes measured were 
knowledge of glaucoma, self-report of adherence, illness perception, beliefs about medicines, 
patient enablement, and general health (Short Form-12). Adherence was also measured objec- 
tively using a Medical Events Monitoring System device. 

Results: Twenty-six participants consented to undertake the educational program and 
19 produced analyzable data. Knowledge of glaucoma, illness perception, beliefs about medi- 
cine, and patient enablement all showed statistically significant improvements after education. 
Mean adherence with eye drops was maintained above 85% before and for 3 months after 
attendance at the educational program. Self-report exaggerated adherence by at least 1 0% when 
compared with the objective Medical Events Monitoring System data, and in fact the kappa 
agreement was zero. 

Conclusion: All questionnaires other than the Short Form-12 were considered to be valu- 
able measures and use of a Medical Events Monitoring System device was considered to be 
an objective surrogate measure for adherence with eye drops. A multicenter, randomized, 
controlled equivalence trial of group versus individualized education using adherence as the 
primary outcome is the next step. 

Keywords: group-based education, glaucoma, adherence, patient compliance 

Introduction 

Lack of adherence with ocular hypotensive therapy is viewed as a serious contributory 
factor in the progression of glaucoma. 1-3 Adherence is defined as the degree to which 
medication-taking behavior "corresponds with agreed recommendations from a health 
care provider." 4 It is difficult to be absolutely confident regarding rates of adherence in 
the literature because different measures of adherence have been employed; however, 
a systematic review of nine studies reported that 23%-60% of patients studied were 
nonadherent at 12 months. 5 Additionally, a proxy that has been used for adherence 
is persistence. Persistence is defined as time from starting to discontinuing therapy. 
A recent systematic review of five studies of medical chart reviews reported that, on 
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average, 67% of patients were persistent after starting their 
eye drops one year previously. 6 However, persistence is a 
coarser and less clinically relevant measure than daily adher- 
ence. Research also shows a variety of patterns of nonadher- 
ence, in that patients may take small or long breaks from eye 
drops then resume again, only to be nonadherent again a few 
days, weeks, or months later. 7 

There are many patient-identified facilitators or barriers to 
adherence with glaucoma eye drops, which may be amenable 
to adherence interventions, including forgetfulness, lack of 
routine, lack of knowledge about glaucoma, and difficulties 
with drop instillation. 8-11 The findings of the relevant stud- 
ies also reveal that individuals often report more than one 
reason for nonadherence. This suggests that interventions 
will need to consist of more than education about glaucoma 
but should include, among other things, practical assistance, 
such as teaching eye drop instillation technique. While the 
studies on facilitators or barriers to adherence are helpful, 
they are not framed in terms of health education needs and 
cannot be utilized as preparatory work for developing a health 
education intervention. Health education needs are defined 
as "any planned activity designed to produce health or illness 
related learning." 12 

Given that in the UK approximately one million patients 
attend for glaucoma outpatient appointments per annum, 2 
any health education intervention needs to be targeted to 
those patients in whom the greatest effect may be achieved. 
One study found that inexperienced patients, ie, those 
naive to therapy, were significantly more likely to discon- 
tinue therapy within 30 days of starting compared with 
more "experienced" patients. 13 At least two studies have 
reported that patients need support and education when first 
placed on treatment. 1114 Altogether, there appears to be a 
need to deliver interventions to improve adherence early in 
the patients' trajectory of care. 

To date, most interventions have been delivered to single 
patients. 15 The interventions delivered to single patients could 
be described as resource-intensive and may not be viewed as 
a viable option in the current financial climate. 16 Arguably, 
in addition to delivery to single patients, a complementary 
approach would be to deliver interventions to groups of 
patients with glaucoma. Prior to undertaking this project, 
there had been two studies exploring group-based educational 
interventions in patients with glaucoma, but neither stated 
whether the intervention was based on patients' health educa- 
tion needs nor did they investigate the effect of the interven- 
tion on adherence with eye drops. 1718 Therefore, evidence 



is lacking on what a group-based education intervention 
should comprise, and whether it is effective in improving 
adherence. 

This paper reports on the second part of an "action 
research" project which aimed to develop and then pilot 
a group-based educational intervention to improve adher- 
ence with ocular hypotensive therapy. Action research is 
defined as "a participatory and cyclical process which aims 
to advance knowledge while executing an improvement in 
health care practices." 19 Our previous paper reported the 
identification of nine patient health education needs regard- 
ing adherence with glaucoma treatment. 20 The current paper 
details the second stage of that project, and presents data 
on an exploratory study of the educational resources devel- 
oped from those health education needs with the intention 
to use the data to develop a future randomized controlled 
trial (RCT). 21 

Materials and methods 

Our research objectives originated from the intention to 
perform a future RCT The objectives were to: 

• assess the rate of recruitment 

• measure participants' attendance at the education 
sessions 

• evaluate participant outcomes before and after the educa- 
tion intervention 

• assess the most appropriate outcome measures 

• measure participants' actual daily percent adherence 
using a Medical Events Monitoring System (MEMS) 
device 

• understand participants' views on group education. 

Study design 

The study was a quasi-experimental before and after study. 
This design was chosen for the following reasons: 

• we did not know whether group-based education would 
be acceptable to participants 

• we did not know whether the content and format of the 
group-based education were workable 

• we did not know whether MEMS would work, because 
at the time of the start of the study no one had reported 
using MEMS. 

With these unknowns, it was considered unwise at this 
stage to invest in an RCT, so a before and after design was 
carried out to inform development of any future RCT. The 
study received ethics approval from the Manchester ethics 
committee (09/H 1000 8/4). 
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Participants 

Participants were recruited from one large hospital in the 
North West of England between June 2010 and September 
2010. The intention was to be as inclusive as possible. We 
did not want to restrict the sample to those who were non- 
adherent because there is no widely accepted level at which 
nonadherence is deemed unsafe, and adherence behavior is 
not stable and tends to decline over time although at differ- 
ent rates. 5 

Inclusion criteria were: outpatients attending a glaucoma 
clinic; age over 18 years; and diagnosis of chronic open 
angle glaucoma, ocular hypertension, or normal tension 
glaucoma (it is understood that, in some countries, eye drop 
use is negotiable in patients with ocular hypertension, but 
in the UK, if drops are prescribed the expectation is com- 
plete adherence); diagnosed within the last year; hypoten- 
sive eye drops prescribed as monotherapy once daily; and 
angle grades &2 using Shaffer's angle grading system. 22 
Exclusion criteria were: secondary glaucoma, angle closure 
glaucoma, diabetic retinopathy, or any other diseases or 
ocular surgical procedures capable of affecting intraocular 
pressure; allergies to ocular medication; unavailability of 
interpreters; and any condition which prevented participants 
from learning in groups. 

Participants were consecutively recruited into two sequen- 
tial groups to undertake a group-based education program. 
A maximum of 16 participants per group were targeted 
because a systematic review on the effectiveness of group- 
based education for patients with type 2 diabetes reported 
that group sizes of 16-18 were as effective pedagogically as 
smaller sizes. 23 Due to the numbers recruited the program was 
run twice, so as not to exceed 16 per group, and in order to 
gain a sufficient sample size to estimate parameters for out- 
come measures in any future pilot RCT. 24 By collecting data 
before and after the intervention, participants acted as their 
own controls, which typically reduces sources of variability. 

Procedures 

During recruitment, patients were invited to attend a group- 
based education program to see its effect on eye drop adher- 
ence, and if they agreed full informed consent was taken for 
the study. Figure 1 shows the flow of participants through the 
study. Baseline assessments of the outcome questionnaires 
were taken one month before the group-based educational pro- 
gram and at one and 3 months after delivery of the program. 
Adherence with eye drops was observed continuously from 
one month before to 3 months after intervention. 



Intervention and follow-up 

An adult learning approach to group-based education seemed 
the most appropriate for people with glaucoma. 25 This was 
because it was in keeping with our health education approach 
which sought to place emphasis on strengthening and opti- 
mizing people's capacities to control their own health. This 
approach meant that an interactive style of learning would 
be provided which drew on participants' experiences and 
allowed them to ask questions (supplementary material). 
Overall, it was concluded that we could deliver the content 
in two sessions one week apart, lasting no longer than two 
and a half hours each. Having two sessions would also enable 
important messages to be reinforced and be in the realms of 
participant acceptability of duration. Supplement 1 shows 
the content of the program alongside the learning approach 
utilized both of which were established by patients and 
health care professionals during the preceding action research 
study. 20 A glaucoma-trained nurse led the educational pro- 
gram supported by at least one other health professional. 

Outcome measures 

Because this was a feasibility study, our objectives were to 
test measures likely to be utilized within a future RCT on 
the effects of the group-based education concerning adher- 
ence with eye drops. The revised Glaucoma Adherence 
Questionnaire (GAQ-R), 26,27 which measures adherence and 
knowledge of glaucoma, was chosen because we have used 
this previously in glaucoma adherence studies. The Revised 
Illness Perception Questionnaire (IPQ-R), 28 the Beliefs about 
Medicines Questionnaire (BMQ), 29 and the Patient Enable- 
ment Instrument (PEI) 30 were chosen because illness repre- 
sentations, beliefs about medicines, and self-control have 
been found to be related to adherence in other fields as well 
as in glaucoma. 27 The general health questionnaire, ie, the 
Short Form- 12, 31 was administered to identify if there were 
any changes in the general health of the participants during 
the study, given that general health may influence adherence. 
The GAQ-R has 14 items focusing on adherence and knowl- 
edge, with a maximum score of 1 9; it has been shown to have 
good internal consistency (Cronbach's a 0.90). 26,27 The IPQ-R 
was used to assess perceptions and beliefs about glaucoma 
and has been used widely in other chronic conditions. It has 
seven subscales (timeline, time cycle, consequences, personal 
control, treatment control, illness coherence, emotional 
trauma). The BMQ was employed to measure beliefs about 
medication, and has two subscales (ie, necessity subscale and 
concerns subscale). The PEI was used because it measures 
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59 invited 



33 refused to 




participate 


■* 







26 consented and divided 
consecutively into two groups 



One ineligible 
patient, one did not 
attend educational 
intervention 




21 attended educational 
intervention 




Three did not 
attend educational 
intervention 



Questionnaire 
data 
n = 21 



Group 1 
n = 12 



Group 2 
n = 9 



One did not return 
MEMS, one taking 
eye drops twice a day 



Attended educational intervention and viable MEMS data 





Figure I Flow diagram showing recruitment of participants. 
Abbreviation: MEMS, Medical Events Monitoring System. 



feelings of empowerment and ability to cope with illnesses 
and the treatments associated with them. 30 Scores of up to 12 
are achieved on the PEL Additionally, the Short Form- 1 2 was 
employed to measure general health. Permission was gained 
from the authors to make minor alterations to the question- 
naires so that items were pertinent to people with glaucoma 
using eye drops. All questionnaires were sent and returned 
by post, and were scored as per guidance of the authors who 
devised the questionnaires. 28-31 

In the absence of any pre-existing gold standard measure, 
adherence with glaucoma eye drops was measured objec- 
tively using a MEMS container. 32 This is a plastic container 
with a screw top in which the eye drop bottle is stored until 
needed for drop instillation. An electronic record is made of 
the date and time that the top is unscrewed and this is taken 



as a surrogate for administering the medication. Participants 
were told how the MEMS works (including that it recorded 
when the bottle was opened and that this was being taken as 
a measure of them taking their eye drops) and were trained 
how to use it correctly. The MEMS device has previously 
been tested to measure adherence with eye drops in people 
with glaucoma. 33,34 Participant's self-reported adherence was 
also measured by seven questions requiring a response to a 
five-item Likert scale in the GAQ-R. 26,27 

Participants' opinion of educational 
program 

All participants were invited for interviews to evaluate 
the educational program. In particular, they were asked to 
focus on those areas of strength and areas for improvement. 
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Organizational issues, including barriers to attendance, were 
included in order to ensure that these could be addressed in 
any subsequent studies. 

Analysis 

The MEMS timestamp data were used to calculate the per 
participant percentage of adherence in the 4 weeks before the 
education program, and for one and 3 or more months after 
the intervention. To allow the participants to settle down with 
the MEMS, the first 2 weeks of pre-education data were dis- 
carded and only data for the 2 weeks preceding the intervention 
were used. Participants were considered to be adherent if they 
administered their drops within a window around their previ- 
ous time of administration (2 hours before and 2 hours after). 
This relative definition of adherence is arguably less harsh 
and more realistic than an absolute definition of adherence, 35 
because it accommodates when participants might switch from 
regular morning medication to regular evening medication. By 
counting the number of adherence events in a period, we also 
covered for the effect of multiple openings in a short space 
of time. Individual adherence patterns and collective patterns 
were scrutinized and plotted. To aid clarity of presentation of 
the adherence results, doses taken were plotted in the follow- 
ing way because the raw scale plots were uninformative due to 
outliers dominating the scale. First, the natural log (In) of the 
interval time between individual doses was calculated in order 
to reduce the effect of outliers, and then In (24) was subtracted 
to center the plots about an axis of perfect adherence (y = 1). 
Reference lines were added to show the adherence window. 
The overall percentage of adherence during a period for each 
participant was calculated as the fraction of the number of 
adherent events divided by the number of days. Due to the 
relatively small sample size, a simple paired ?-test was used 
to compare between pre-intervention and post-intervention 
adherence rates (rather than a generalized estimating equation 
approach 35 ). The time of intervention was considered to be 
immediately after the first session. 

Questionnaire scores were analyzed using repeated- 
measures analysis of variance or the equivalent nonparametric 
Friedman's test as appropriate. Total scores from 
the questionnaires and dichotomous adherence variables 
were compared over the three time points, and 95% confidence 
intervals (CIs) were calculated. Results were interpreted with 
caution because the study was not powered to test hypotheses, 
but were being calculated to inform and provide the basis of 
a sample size calculation for any future RCT 

To assist with the design of a future RCT, we also com- 
pared the rates of adherence between the MEMS data and 



the GAQ-R to gain insight as to the validity of the Gray et al 
questionnaire. 26,27 We descriptively assessed recruitment, 
attrition, and data collection procedures. 24 Statistical Package 
for the Social Sciences version 16 software (SPSS Inc, 
Chicago, IL, USA) was utilized for all analyses. 

Results 

Fifty-nine patients were invited to participate and 26 were 
recruited. Reasons for nonparticipation included the inability 
to attend group sessions and not wanting to take part in the 
research. Two dates were set, and participants were divided 
consecutively into two groups. Given that this was a feasibil- 
ity study and in order to maximize the numbers undertaking 
the educational program, patients were offered another date if 
they were unable to attend the sessions allocated due to other 
commitments. One person could not attend the date arranged 
for session 2 so moved to group 1 , hence the unequal numbers 
per group (Figure 1). Otherwise there was no movement. 
Group 1 had 14 participants and group 2 had 12 participants. 
A total of 21 participants attended the educational interven- 
tion, and all but one returned the MEMS bottle after taking 
once-daily medication (Figure 1). 

Demographic data 

The average age of the participants who attended the educa- 
tional intervention was 69 (range 44-89) years and 1 1 were 
male. Over half of the participants had retired from full-time 
work (n =13), three continued to work full-time, two worked 
part-time, and three were unemployed. According to the 
medical notes, 14 of the participants had chronic open angle 
glaucoma, three had ocular hypertension, and four had normal 
tension glaucoma. 

Descriptively, there were no differences between 
the groups with regard to age, employment status, and 
diagnosis; however, group 1 consisted mainly of females 
(75%) and group 2 consisted mainly of males (88%). 
Median adherence pre-intervention was significantly differ- 
ent between the groups (0.93 in group 1 and 0.67 in group 
2; P = 0.036, Mann- Whitney) before intervention, but was 
not significantly different up to one month (0.87 in group 1 
and 0.83 in group 2; Mann-Whitney P = 0.6) or after one 
month post-intervention (0.92 in group 1 and 0.85 in group 2; 
Mann- Whitney P = 0.2). 

Questionnaire data 

The GAQ-R questionnaire demonstrated that participants had 
a significant increase in their knowledge scores immediately 
post-intervention (P < 0.0001), which was maintained at the 
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3-month time point (P < 0.0001). Mean scores had changed 
from 10.1 (score range 4—19) before educational intervention 
to 14.1 (score range 7-19) immediately post-intervention, 
and 13.5 (score range 7-19) 3 months post-intervention. See 
Table 1 for all questionnaire data. All seven subscales of the 
IPQ-R showed statistically significant differences one month 
after the educational program (P = 0.002 to P < 0.0001) of 
at least two points. PEI scores showed significant differences 
post-intervention compared with before intervention. The 
mean score before intervention was 4.1, which increased 
to 6.6 immediately post-intervention (P = 0.008), and rose 
further to 6.7 at 3 months post-intervention (P — 0.012). The 
BMQ scale only showed significant changes in the subscale 
of necessity between before and 3 months post-intervention 
(P= 0.017), ie, an increase from 3.7 to 4.1. Although scores 
did change in the specific concerns scale, these were not sig- 
nificant (P= 0.3). The Short Form- 12 showed nonsignificant 
increases in scores immediately, but these were reversed 
by the time of the 3-month follow-up. Overall, the Short 
Form- 12 scores showed no significant change. 

Adherence data 

MEMS data were analyzed using participants who undertook 
the education program and returned their MEMS bottles 
(n= 19; 12 from group 1 and seven from group 2). One partici- 
pant from group 2 did not return the MEMS bottle and another 
(also in group 2) was taking twice-daily eye drop medication so 
was excluded from the analysis. Four participants did not attend 
the program (one from group 1 and three from group 2). 

The number of days for which eye drop data were col- 
lected (after intervention) ranged from 39 days to 99 days 
(mean 91 days). One participant from group 2 stopped 
taking the eye drops on day 77 of the study (39 days after 
intervention). The percentage number of days prior to inter- 
vention that the correct dose was taken was 88.7% (95% 
CI 84.9-92.6), at post-intervention day 1-30 it was 85.9% 
(95% CI 82.9-88.9), and at post-intervention day 31-99 it 
was 86.4% (95% CI 83. 1-89.8). However, this summary may 
mask individual improvement or worsening of adherence. 
The time between doses varied considerably, with most 
clustering within the agreed 4-hour adherence period but 
many participants administered doses outside this period. 
For instance, participant GB5 did not administer a dose for 
72 hours part way through the study, whilst participant GB22 
had gaps of 220 hours and 260 hours for the last two recorded 
doses (Figure 2). Most took their eye drops consistently 
between 7 pm and 2 am, while a third took them between 
7 am and noon. Figure 3 shows the individual plots of eye 



drop administration, indicating a variation in time intervals 
between when the drops were taken each day. 

Scheduled doses (± 2 hours) 

The overall participant adherence rate was maintained over 
time, with the majority remaining approximately 85% adher- 
ent before and after the educational intervention. Adherence 
was low on the day of intervention (40%) which is probably 
an artifact due to participants testing the opening of the 
MEMS bottle, and afterwards the adherence rate rose sharply. 
Within the figures are wide daily variations in the mean daily 
adherence rate (Figure 4). However, towards the end of the 
study, the variations did appear to have reduced and settled 
above a mean of 85%. There was no significant difference 
between pre and post (day 1-30) adherence rates (t = -0.2, 
df= 18, P = 0.8), or between pre and later post adherence 
rates (day 31+) (/ = -0.1, df= 18, P = 0.9) when examin- 
ing the adherence rate on an overall per participant basis; 
however, the effect of the intervention was different for each 
individual. Figure 5 plots the individual pre and post overall 
adherence rates for each participant. Eleven participants 
improved their adherence from the pre-intervention baseline, 
whereas seven participants reduced their adherence at both 
post-intervention time points. 

Participant reports of adherence 

Participants were asked about their adherence using the 
GAQ-R. They were asked how many drops they missed per 
month (0, 1-3, 4-6, or 7+), and the longest period during 
which they stopped using their drops. The majority (63%) 
said they did not miss any drops, and no participants reported 
missing more than 4-7 drops at any time, even though 
some did so according to MEMS data. The adherence rate 
increased from 63% (exact 95% CI 38-83) to 74% (exact 
95% CI 49-91) one month after the intervention. However, 
only 58% (exact 95% CI 33-80) reported missing no doses 
3 months after the educational intervention. 

To compare the GAQ data and MEMS data, we 
calculated the maximum number of drops missed at each 
time point and the number of person-days to obtain a 
percentage adherence. This percentage GAQ adherence was 
conservatively estimated using the highest number of missed 
doses per range, as 95% (=l-[3x5 + 6x 2]/[19 x 30]) 
pre-intervention, 97% at one month post-intervention, and 
95% at 3 months post-intervention, so participants consis- 
tently overestimated their actual adherence as measured 
by the MEMS. This is further supported when MEMS 
percent adherence was directly compared with GAQ using 
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Figure 2 Time between doses for each participant. 

Notes: This figure uses all data from 1 4 days pre-intervention for the 1 9 participants who completed the educational program. The solid green line is at 24 hours. The dashed 
red lines are at the adherence boundaries of 22 hours and 26 hours. 
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Figure 3 Individual adherence plots (time between drops). 

Notes: Time from first intervention. The In (Interval/24) axis has been used to aid presentation of the profiles. Observations on the y-axis at zero are perfect adherence (ie, 
exactly 24 hours since the last medication), while observations away from this line represent loss of adherence. 
Abbreviation: GB, group based. 
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Notes: Day 0 is the day of the first educational intervention. Daily adherence is the percentage of patients who were adherent on each day. 
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Spearman's correlation. A negative correlation was found 
between pre-intervention values (r = -0.37, P = 0.1) and 
at one month post-intervention (r = -0.45, P = 0.053). At 
3 months post-intervention, the correlation was no longer 
negative but approximately zero (r = 0.043, P = 0.9). The 
agreement between MEMS percent adherence and the GAQ 
was assessed using a weighted kappa statistic, based on a pro 
rata estimate of monthly MEMS adherence. This statistic 
was zero for all three time periods, because participants had 
systematically underestimated the number of doses they 
missed per month. These figures were used to inform an 
illustrative calculation for weighted kappa calculation of the 
sample size required for any future RCT A sample size of 
1 20 participants would be required to estimate a kappa of 0. 1 
(with a disagreement rate of 0.8) to within an interval of 0.4 
with 95% probability. 

Participant perspectives 

Participants reported overwhelming support for the pro- 
gram, identifying how much they had learnt and praising the 
educator. A few reported that it made them feel more confident 
to ask questions and instill eye drops. Participants thought that 
the timing and number of sessions were appropriate. 

Discussion 

This study was designed to assess the feasibility for an RCT 
to assess the effects of a group-based education program 
on adherence with eye drop therapy. It is the first to look at 
the relationship between group-based education and illness 
perception, patient enablement, knowledge of glaucoma, 
beliefs about medicine, and general health. At the 3-month 
follow-up, there was a significant improvement in illness 
perception, patient enablement, knowledge of glaucoma, and 
in beliefs about medicine. This suggests that the participants 
felt that they understood their illness more and that they 
were now capable of taking an active role in their treatment. 
The BMQ concerns subscale did not show a difference, 
hence they continued to have concerns over the medication 
that they were taking but were now more likely to continue 
taking the eye drops despite this. While these findings need to 
be treated with caution because of the limitations of a small 
exploratory before and after design, they support findings 
from another study which sought to improve adherence 
through an individualized assessment and plan of action to 
improve adherence, 27 and as such confirm that they are valid 
outcome measures for the future RCT. There was no change 
in general health as measured by the Short Form- 12. This 
is expected in a chronic condition over such a short period 



of follow-up and suggests that this measure should not be 
used in the RCT. 

The rate of recruitment was almost identical to that of the 
forerunner of this study (approximately 45%), 36 indicating 
that there were no unexpected barriers to participation in 
a group-based education intervention. The attrition rate of 
4/25 (16%) for attendance at the educational program was 
reasonable (comparison with previous glaucoma studies 
on group-based education is difficult because neither study 
reports attrition 1718 ) and only 1/25 (4%) did not return the 
MEMS, the source of data for what is likely to become the 
primary outcome measure in the RCT making it a useful 
instrument to measure adherence in future studies. This 
indicates that recruitment and retention of participants in an 
RCT is likely to be satisfactory. 

During the life of this project, a study of the impact of a 
single 2-hour education session on persistence of glaucoma 
treatment was reported. 37 Blondeau et al found no effect on 
persistence before and after the education session, which is 
consistent with our finding that adherence remained level 
before and after our education program. 37 Both studies used 
before and after methods, and were not powered to assess the 
effectiveness of the group-based intervention. Control groups 
were not utilized so it is difficult to draw definitive conclu- 
sions. Our focus was on the feasibility of carrying out a trial 
in the future, and at first sight it could be thought that adher- 
ence was not affected and that the trial may not be indicated. 
However, the data demonstrate that participants who underwent 
the group-based intervention maintained their initial levels of 
adherence when normally adherence levels would be expected 
to decline (irrespective of what measurements are used), 6 sug- 
gesting that an RCT would be meaningful. Decline in adher- 
ence should be combated in order to minimize the irreversible 
progression of glaucoma. A sample size of 120 is suggested 
which is manageable given the prevalence of glaucoma. 

A gold standard measure of adherence remains elusive, 
but this experience of using MEMS suggests that it is useful 
as an objective measure. There remain issues associated with 
the determination of adherence; we utilized a 4-hour window 
based on advice from local consultant ophthalmologists, with 
other researchers in this field using a more lenient measure 
(ie, an 8-hour window [+ 4 hours] of prescribed time 7 ). Also, 
a relative definition of adherence (interval between doses) 
allows for participants to adjust their routine, and is more 
pragmatic than defining adherence as being assessed against a 
prescribed (ie, fixed) time of day. However, there is no reason 
why both windows cannot both be analyzed in future stud- 
ies in a sensitivity analysis. From a practical point of view 
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we found that, to interpret data from the MEMS, it is best 
to transfer it with the help of a statistician onto a Statistical 
Package for the Social Sciences database. 

Our findings support those of other researchers showing 
that self-report methods of adherence are unreliable because 
participants have a tendency to over-report their adher- 
ence. 38 For example, one study found that 76% + 24.3% of 
participants had objectively instilled their eye drops whereas 
at interview 97.1% + 5.9% of the same participants claimed 
they had been adherent. 39 Another study found that glaucoma 
patients tend to have increased social desirability scores com- 
pared with their normal counterparts, supporting the propen- 
sity for self-report to be unreliable. 40 Our comparison of the 
MEMS data and the self-report data suggest that participants 
tend to overestimate their adherence. A conservative estimate 
of the mean self-report levels of adherence was 95%, 97%, 
and 95% at the three time points, but the MEMS recorded 
respective mean percentages of 89%, 86%, and 86%, giving a 
difference between self-report and an objective measurement 
of adherence in this study of approximately 10% at least. 
This difference is lower than the 20% identified by Kass et al 
when studying application of pilocarpine drops using an 
"unobtrusive eye drop medication monitor" in the 1980s. 39 
This method of summarizing adherence is more granular 
than using categories and the kappa agreement statistic, 
which simply showed whether there was disagreement but 
not in a useful and interpretable way. It is entirely possible 
that the MEMS data are more accurate due to improvements 
in technology over the past 30 years. 

Because participants were aware that MEMS measured 
their adherence, it is possible that using it artificially increased 
adherence in our group. Despite this, adherence levels are 
within the range reported previously in studies using other 
forms of adherence measures, so we do not consider it to 
have affected our results and conclusions. 

Although the average adherence was high for glaucoma, 
the consequences of nonadministration are so adverse (ie, 
progression to extensive visual impairment), target adherence 
should be 100%. It might be argued that it would be cost- 
effective to target strategies aimed at improving adherence, 
such as group-based education, to those who are nonadher- 
ent, but it is difficult to know how to identify these patients, 
because it has been shown that self-report is inaccurate. The 
clinical advantage of improving adherence in glaucoma is 
substantial enough to suggest that all patients should be 
included in future trials. 

Data collection procedures proceeded satisfactorily with 
no difficulties. The process evaluation from the participants' 



perspective indicated no unintended outcomes or adverse 
effects. All the data outcome measures appear to produce 
results that are sensitive to change and, additionally, from pre- 
vious studies using the IPQ-R, GAQ-R, BMQ, and PEI, 27 we 
feel confident that there would be value in using them again in 
an RCT, except for the self-report measures of adherence. 

Prior to the education program, patients in group 2 
were less adherent than those in group 1 (67% versus 93%; 
P = 0.036) but this variation did not continue after the educa- 
tion programme, and so did not affect our conclusions, given 
that the comparison was between adherence before and after 
intervention rather than adherence between groups. 

Four participants were recruited who were unable to 
attend the education intervention due to unforeseen circum- 
stances and the finite time available for this study. A cursory 
overview of their data shows that their mean adherence prior 
to the time of intervention was 74.9% and reduced to 30.2% 
at 3 months after the time of intervention, and that their 
knowledge of glaucoma remained stable between these times. 
Although an extremely low number of participants were in 
this group, these data add support to the argument that adher- 
ence declines over time without the intervention. 

No economic evaluation was undertaken at this stage, 
because we worked on the premise that group-based educa- 
tion would be more cost-effective than individual education. 
A future RCT would need to confirm this assumption. 

Participant interviews appear to demonstrate that the 
program met expectations. Participants said that they learnt 
a great deal and found it enjoyable, and no negative com- 
ments were made. They also reported feeling empowered to 
ask questions of their doctors and were of the opinion that 
such a program should be part of routine care. Therefore, we 
conclude, from a participants' perspective, that this interven- 
tion warrants further formal testing in an RCT. 

Altogether, the findings of this feasibility/pilot study indi- 
cate that we should proceed to a full evaluation comprising 
an assessment of effectiveness and cost-effectiveness and 
an understanding of change processes, including fidelity to 
the intervention. 21 There is a need to compare group-based 
education with that delivered to single patients, and the find- 
ings from this study suggest that an equivalence trial would 
be most appropriate. 

Limitations 

This was a before and after study, with participants acting as 
their own controls. The results would be strengthened using a 
separate control group, but this was a pilot study to establish 
proof of principle. There are potential selection bias issues, eg, 
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some participants had been diagnosed with glaucoma for some 
months and had continued to attend clinics prior to recruitment 
into the study. It is possible that engagement in clinic atten- 
dance and adherence with medication are related, and hence 
it is possible that we recruited more adherent participants. 
Additionally, our recruitment rate of 32% may also suggest 
self-selection of adherent participants. However, our data show 
that the adherence profile of the participants was wide-ranging 
(some adherent and others nonadherent), which is similar to 
previously published profiles, so we believe that our sample, 
although small (with low external validity), was representative 
of a population of medication-takers. The duration of follow-up 
in our study was 3 months due to funding constraints, so any 
long-term effects cannot be gauged from these results. 

Conclusion 

Education delivered to single patients with glaucoma has 
been found to be effective in some studies, but no definitive 
evidence exists to date for the effectiveness of group-based 
education. A group-based education program was developed 
and piloted at one hospital in the North West of England. 
We conclude that the group-based education program may 
be feasibly delivered in a clinical environment accessible by 
people with glaucoma, retention is reasonable, and outcomes 
including the maintenance of adherence appear favorable. 
Therefore, group-based education is suitable for further 
evaluation in an equivalence RCT. 
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Supplement I Content of a group-based educational program for patients with glaucoma to improve adherence with eye drops 



Manchester group-based 

education program 

(Numbers indicate learning outcome) 



How learning outcome will be met 



Duration 
(minutes) 



Session I 

For group to chat informally prior 
to start of the session 

1 . To understand the diagnosis/understand 
difficulties with giving a diagnosis 

2. To understand glaucoma 
9. To put the condition into 

perspective — to know how to 
manage their risk 



1 . To understand the diagnosis/understand 
difficulties with giving a diagnosis 

2. To understand glaucoma 
9. To put the condition into 

perspective — to know how to 
manage their risk 



3. To understand the implications of eye drops 

4. To understand the side effects 
of eye drops and tablets 

5. To feel confident to instill 
eye drops 



8. To understand their own reasons 
for nonadherence 



10. Referring them to other sources 
of information and support 



Session 2 

Tea and coffee prior to start of session 
8. To understand their own reasons 
for nonadherence 

6. To be able to ask questions of the doctors/ 
nurses/optometrists involved in their care 

7. To be able to challenge the system 



Provide patients with tea, coffee, and biscuits - informal chat 

Serve tea/coffee throughout the sessions, so patients 

can help themselves 

In groups of 3—4, discuss: 

• Why are you here today? 

• How did you get referred to the eye hospital? 

• What happened after you were referred? 

• What do you know about your condition? 

• What do you want to know? 

• What problems (if any) did you encounter in the last month 
related to either diagnosis or drops? 

The professional facilitators will use the examples, identified by 
patients from the "patient discussion" above to illustrate the following: 

• How the eye works 

• What is glaucoma? (including eye pressure) 

• Difficulties of giving a diagnosis 

• Different types of diagnosis 

• How might glaucoma affect my eye sight? 

• What to expect at an eye clinic appointment (explain tests such 
as field test, link to eye drops - what have they been 
prescribed/have drops been changed?) 

Linked from previous segment "what to expect at eye clinic appointment"): 

• Practice instilling eye drops (practical workshop) - use of aids 
to help instill eye drops 

• Professional facilitator will use examples from previous discussion to : 

• explain how eye drops work to control glaucoma 

• explain if eye drops interfere with other medicines 

• side effects of drops 

• Practical issues - eg, should they be kept in fridge/what if I work 
nights?/do they have to be put in same time each night? 

• Start to discuss behavior of using drops/beliefs about 
drops/medicines in general 

Participants are supported to develop their own understanding 
of adherence and how they might maintain/improve it. This is 
done via group and individual discussions using a "questionnaire" 
to facilitate discussion 

Professional facilitators hand out information (leaflets) 
Have list of information sources 

Book appointment for individual chat with health professional 
Facilitator to ask more formal questions of group to assess 
if learning outcomes have been met 

In group discuss how useful the course has been for them, 
good points, points to improve, what would they change? 



Group activities - feedback on adherence behavior - how have 
their plans to maintain/improve adherence worked? 

Practical advice re how to find out information they need in a consultation 
Tips "n" tricks + group discussion 

• Write down questions you have before you go in to consultation 

• Take somebody in to consultation with you so they remember if you don't + 
opportunity to have individual chat with a health professional for advice 



Prior to start 
of session proper 

20 



30 



45 



20 



15 



30 



40 



(Continued) 
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Supplement I (Continued) 



Manchester group-based 


How learning outcome will be met 


Duration 


education program 




(minutes) 


Learning outcome 






9. To put the condition into 


Professional and patient facilitators moderate discussions on: 


20 


perspective - to know how 


DVLA regulations for patients with glaucoma 




to manage their risk 


lifestyle and glaucoma 




Evaluation 


Group discussion 

Action plan - what are they going to do differently as a result 
of attending the group-based education sessions? 
Discuss how useful the course has been for them 
Good points, bad points, what would they change? 


10 



Abbreviation: DVLA, Driver and Vehicle Licensing Authority. 
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